Limitations of the MPEG-7 Generic DS: Reorganizing the Syntactic/Semantic DS’s

In this document, we propose some modifications to the MPEG-7 Description Scheme (DS) [1] in order to enrich the structure of the Syntactic DS and Semantic DS by addressing some functionalities for semantically characterizing segments and for highlighting and ordering key-items in a multimedia document. In our opinion, the Generic DS and in particular the syntactic DS can demonstrate some weakness in describing hierarchically organized documents. In other words, even if it is enunciated [1] that the Syntactic DS should act as the Table of Contents for the multimedia document being described, the description of the document temporal structure seems complicated. Therefore we start our discussion by implementing the ToC DS part of our old MPEG-7 proposal (the ToCAI DS [3]) using the MPEG-7 Generic DS [1]. In our opinion, due to the simpler structure of the ToC DS, this implementation allows to show the complexity of the MPEG-7 DS. For overcoming such a problem, we propose a simble extension of the Syntactic DS of the MPEG-7 Generic DS in order to handle semantic aspects of each segment directly at the Segment DS level. Another issue that we analyze in this document is a possible extension of the MPEG-7 Generic DS for the inclusion of some important functionalities: the capability to (1) highlight description items (e.g. images, sounds, events, objects etc.) most relevant to the purpose for which a certain content description of a multimedia (MM) document has been created and (2) the capability of description information ordering . In other words, due to a possible large amount of description items, an entity who will create descriptions of multimedia (MM) documents, according to MPEG-7 specification (i.e. a description provider), shall highlight certain items most representative for the kind of document being described in order to facilitate user queries. Besides we consider the need of providing users with ordering mechanisms a very relevant issue for MPEG-7. Such ordering mechanisms are derivable from descriptors (e.g. a set of key – frames ordered on the basis a color descriptor or a set of sounds ordered by means of a loudness D). However a possible large variety in the types of descriptors composing a description could lead to a consequent high number of ordering criteria to arrange description items. Therefore we propose that the description provider should also select which set of descriptors should be combined to order a subset of description elements (e.g. key frames, events etc.) most pertinent to the MM document being described. The document is organized as follows: in Section 2 we explain the motivations for a representation of the ToC DS based on the MPEG-7 Generic DS. In Section 3 after a brief overview of the ToCAI DS, we present the implementations of the ToC DS according to the MPEG-7 Generic DS specifications; we also suggest in this sections some changes to the current specifications to better handle the ToC DS functionalities. Section 4 provides an example of implementation of such a DS. In Section 5, we explain, after a quick overview of the current Generic DS, the motivations behind the proposal for adding highlighting and ordering functionalities. In Section 6, we show the structure of the DS that enable these functionalities. In Section 7, we give an example in order to clarify the concepts of key-items and ordering keys. Finally in Section 8, we provide a brief summary of the contribution

A Video Indexing Approach Based on Audio Classification

This paper presents a video indexing approach based only on audio classification. Indeed, we apply to an audio-visual document a set of methods for partitioning the associated audio data into homogeneous segments. The aim is to highlight semantically relevant items of a multimedia document by relying only on simple audio processing techniques. A simple algorithm to identify audio segments belonging to silence, music, speech and noise classes has been proposed

Validation Experiment on the Ordering Key DS and an Unified Syntax for the Weight DS

This document presents the experimental results for validating the Ordering Key DS (DS5) in the context of the core experiment of the Weight DS [6]. At the Melbourne MPEG meeting, in October 1999, the aforementioned core/validation experiment was planned in order to show the validity of a set of proposals (Weight DS [5], Descriptor Usage DS [8], Fidelity DS [9], Pointofview DS [4] and Ordering Key DS [7]). In a few words, all these DSs play the role of highlighting, by means of some kinds of weights, description information (DSs or Ds) relevant to user queries. They can provide, for example, confidence measure, priority, fidelity, relevance feedback, information for ordering etc. in order to facilitate user queries and browsing. As we said, the document focuses on the VE of the Ordering Key DS. Besides it presents an unified DS, in MPEG-7 DDL syntax, that addresses all the different functionalities proposed by the several DSs involved in the CE. In our case, the provided functionality deals with the concept of ordering, as we consider the need of providing users with ordering mechanisms a very relevant issue for MPEG-7. Such ordering mechanisms are derivable from descriptors (e.g. a set of key – frames ordered on the basis a color descriptor or a set of sounds ordered by means of an audio loudness D). However a possible large variety in the types of descriptors composing a description could lead to a consequent high number of ordering criteria to arrange description items. Therefore we propose that the description provider (it could be different from the content provider) should also select a reduced set of descriptors allowing to order a subset of description elements (e.g. key frames, events etc.) pertinent to the MM document being described [7]. This contribution is organized as follows. In Section 2, the motivations for introducing Ordering Key DS in the Generic AV DS are given. Section 3 briefly presents the structure of the Ordering Key DS by means of UML notation and MPEG-7 DDL as well. Moreover the section discusses about the possible locations of the DS within the Generic AV DS. In Section 4 is shown the output of the experiment: a smart browsing of ordered elements belonging to the test set of MPEG-7 video material. Finally, in Section 5, is proposed a unified DDL structure for the DSs involved in the CE

The ToCAI DS for audio-visual documents. Structure and concepts

This document complements the description of the audio-visual (AV) description scheme (DS) called Table of Content-Analytical Index (TOCAI) proposed in MPEG-7 CFP that was evaluated in Lancaster (February 1999). This DS provides a hierarchical description of the time sequential structure of a multimedia document (suitable for browsing) together with an “analytical index” of AV objects of the document (suitable for retrieval). The TOCAI purposes and general characteristics are explained. The detailed structure of the DS is presented by means of UML notation as well, to clarify some issues that were not included in the original proposal. Some examples of XML instantiation are enclosed as well. Then an application example is shown. For an indication on how the TOCAI DS matches MPEG-7 requirements and evaluation criteria, refer to the original proposal submission

Multimedia documents description by ordered hierarchies: the ToCAIdescription scheme

The authors present the ToCAI (Table of Content Analytical Index) framework, a description scheme (DS) for content description of audio-visual (AV) documents. The idea for such a description scheme comes from the structures used for indexing technical books (table of content and analytical index). This description scheme provides therefore a hierarchical description of the time sequential structure of a multimedia document (ToC), suitable for browsing, together with an “Analytical Index” (AI) of the key items of the document, suitable for retrieval. The AI allows one to represent in a ordered way the items of the AV document which are most relevant from the semantic point of view. The ordering criteria are therefore selected according to the application context. The detailed structure of the DS is presented by means of UML notation and an application example is also shown

Describing multimedia documents in natural and semantic-driven ordered hierarchies

In this work we present the ToCAI (Table of Content-Analytical Index) framework, a description scheme (DS) for content description of audio-visual (AV) documents. The idea for such a description scheme comes out from the structures used for indexing technical books (table of content and analytical index). This description scheme provides therefore a hierarchical description of the time sequential structure of a multimedia document (ToC), suitable for browsing, together with an analytical index (AI) of the key items of the document, suitable for retrieval. The AI allows to represent in an ordered way the items of the AV document which are most relevant from the semantic point of view. The ordering criteria are therefore selected according to the application context. The detailed structure of the DS is presented by means of UML notation as well and an application example is shown

A Possible Extension of the Generic AV DS to Incorporate Highlighting and Ordering Functionalities

In this document, we propose an extension for the MPEG-7 Generic DS [2]. We believe that some important functionalities for MPEG-7, not yet addressed by the actual DS, should deal with the capability to (1) highlight description items (e.g. images, sounds, events, objects etc.) most relevant to the purpose for which a certain content description of a multimedia (MM) document has been created and (2) the capability of description information ordering. In other words, due to a possible large amount of description items, an entity who will create descriptions of multimedia (MM) documents, according to MPEG-7 specification (i.e. a description provider), shall highlight certain items most representative for the kind of document being described in order to facilitate user queries. Besides we consider the need of providing users with ordering mechanisms a very relevant issue for MPEG-7. Such ordering mechanisms are derivable from descriptors (e.g. a set of key – frames ordered on the basis a color descriptor or a set of sounds ordered by means of a loudness D). However a possible large variety in the types of descriptors composing a description could lead to a consequent high number of ordering criteria to arrange description items. Therefore we propose that the description provider should also select a reduced set of descriptors allowing to order a subset of description elements (e.g. key frames, events etc.) pertinent to the MM document being described. Our proposal consists in the incorporation in the current Generic Ds of two DSs covering the aforementioned functionalities. The document is organized as follows: in Section 2, we explain, after a quick overview of the current Generic DS, the motivation behind our proposals and in Section 3, we show the detailed structure of the DSs

Особенности плазмохимического травления торцов кремниевых пластин для фотоэлектрических преобразователей

Выбраны оптимальные режимы плазмохимического травления торцов пластин в реакторе, разработанном в ИЯИ, который по производительности превосходит лучший зарубежный аналог при более высоком качестве обработки пластин

ToCAI: A Framework for Indexing and Retrieval of Multimedia Documents

This paper presents the ToCAI (table of content-analytical index) description scheme (DS) for content description of audio-visual documents. The original idea comes from the structure used for technical books. One may easily understand a book's sequential organization by looking at its table of contents while quickly retrieving elements of interest by means of the analytical index. This description scheme provides therefore a hierarchical description of the time sequential structure of a multimedia document (thanks to the ToC), suitable for browsing, together with an “analytical index” (AI) of audio-visual objects of the document, suitable for effective retrieval. Besides, two sub-description schemes for information about description generation and about the metadata associated with the document are also enclosed in the general DS. The detailed structure of the DS is also presented by means of UML (unified modelling language) notation and an application example is shown. Finally, some considerations concerning the adopted visual interface are made